UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis
نویسندگان
چکیده
Our system combines text similarity measures with a textual entailment system. In the main task, we focused on the influence of lexicalized versus unlexicalized features, and how they affect performance on unseen questions and domains. We also participated in the pilot partial entailment task, where our system significantly outperforms a strong baseline.
منابع مشابه
The joint student response analysis and recognizing textual entailment challenge: making sense of student responses in educational applications
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge. The goal of this challenge was to bring together researchers from the Educational Natural Language Processing and Computational Semantics communities. The goal of the Student Response Analysis (SRA) task is to assess student responses to questions in the science domain, focusing on co...
متن کاملUoW: NLP techniques developed at the University of Wolverhampton for Semantic Similarity and Textual Entailment
This paper presents the system submitted by University of Wolverhampton for SemEval-2014 task 1. We proposed a machine learning approach which is based on features extracted using Typed Dependencies, Paraphrasing, Machine Translation evaluation metrics, Quality Estimation metrics and Corpus Pattern Analysis. Our system performed satisfactorily and obtained 0.711 Pearson correlation for the sema...
متن کاملUKP: Computing Semantic Textual Similarity by Combining Multiple Content Similarity Measures
We present the UKP system which performed best in the Semantic Textual Similarity (STS) task at SemEval-2012 in two out of three metrics. It uses a simple log-linear regression model, trained on the training data, to combine multiple text similarity measures of varying complexity. These range from simple character and word n-grams and common subsequences to complex features such as Explicit Sem...
متن کاملSemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge, aiming to bring together researchers in educational NLP technology and textual entailment. The task of giving feedback on student answers requires semantic inference and therefore is related to recognizing textual entailment. Thus, we offered to the community a 5-way student response ...
متن کاملTextual Entailment Using Univariate Density Model and Maximizing Discriminant Function
The primary focuses of this entry this year was firstly, to develop a framework to allow multiple researchers from our group to easily contribute metrics measuring textual entailment, and secondly, to provide a baseline which we could use in our tools to evaluate and compare new metrics. A development environment tool was created to quickly allow for testing of various metrics and to easily ran...
متن کامل